A Robust Bayesian Truth Serum for Small Populations
نویسندگان
چکیده
Peer prediction mechanisms allow the truthful elicitation of private signals (e.g., experiences, or opinions) in regard to a true world state when this ground truth is unobservable. The original peer method incentive compatible for any number agents n >= 2, but relies on common prior, shared by all and mechanism. Bayesian Truth Serum (BTS) relaxes assumption. While BTS still assumes that share prior need not be known However, only large enough agents, particular required uncertain because it depends prior. In paper, we present robust binary information which every 3, taking advantage particularity quadratic scoring rule. first mechanism provide strict compatibility 3 without relying knowledge Moreover, contrast BTS, our numerically ex post individually rational.
منابع مشابه
A Robust Bayesian Truth Serum for Small Populations
Peer prediction mechanisms allow the truthful elicitation of private signals (e.g., experiences, or opinions) in regard to a true world state when this ground truth is unobservable. The original peer prediction method is incentive compatible for any number of agents n ≥ 2, but relies on a common prior, shared by all agents and the mechanism. The Bayesian Truth Serum (BTS) relaxes this assumptio...
متن کاملA Robust Bayesian Truth Serum for Non-Binary Signals
Several mechanisms have been proposed for incentivizing truthful reports of a private signals owned by rational agents, among them the peer prediction method and the Bayesian truth serum. The robust Bayesian truth serum (RBTS) for small populations and binary signals is particularly interesting since it does not require a common prior to be known to the mechanism. We further analyze the problem...
متن کاملA Bayesian truth serum for subjective data.
Subjective judgments, an essential information source for science and policy, are problematic because there are no public criteria for assessing judgmental truthfulness. I present a scoring method for eliciting truthful subjective data in situations where objective truth is unknowable. The method assigns high scores not to the most common answers but to the answers that are more common than col...
متن کاملCreating Truth-Telling Incentives with the Bayesian Truth Serum
Vol. L (June 2013), 289–302 289 *Ray Weaver is Assistant Professor of Business Administration, Harvard Business School, Harvard University (e-mail: [email protected]). Drazen Prelec is Professor of Management, Management Science and Economics, MIT Sloan School of Management, Massachusetts Institute of Technology (e-mail: [email protected]). This research was supported by NSF SES0519141 and the John...
متن کاملValidating Bayesian truth serum in large-scale online human experiments
Bayesian truth serum (BTS) is an exciting new method for improving honesty and information quality in multiple-choice survey, but, despite the method's mathematical reliance on large sample sizes, existing literature about BTS only focuses on small experiments. Combined with the prevalence of online survey platforms, such as Amazon's Mechanical Turk, which facilitate surveys with hundreds or th...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2021
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v26i1.8261